What does touch tell us about emotions in touchscreen-based gameplay?

This is the post-print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 ACM. It is posted here by permission of ACM for your personal use. Not for redistribution.Nowadays, more and more people play games on touch-screen mobile phones. This phenomenon raises a very interesting question: does touch behaviour reflect the player’s emotional state? If possible, this would not only be a valuable evaluation indicator for game designers, but also for real-time personalization of the game experience. Psychology studies on acted touch behaviour show the existence of discriminative affective profiles. In this paper, finger-stroke features during gameplay on an iPod were extracted and their discriminative power analysed. Based on touch-behaviour, machine learning algorithms were used to build systems for automatically discriminating between four emotional states (Excited, Relaxed, Frustrated, Bored), two levels of arousal and two levels of valence. The results were very interesting reaching between 69% and 77% of correct discrimination between the four emotional states. Higher results (~89%) were obtained for discriminating between two levels of arousal and two levels of valence

Reading touch screen storybooks with mothers negatively affects seven-year-old readers’ comprehension but enriches emotional engagement

Touch screen storybooks turn reading into an interactive multimedia experience, with hotspot-activated animations, sound effects, and games. Positive and negative effects of reading multimedia stories have been reported, but the underlying mechanisms which explain how children’s learning is affected remain uncertain. The present study examined the effect of storybook format (touch screen and print) on story comprehension, and considered how level of touch screen interactivity (high and low) and shared reading behaviors (cognitive and emotional scaffolding, emotional engagement) might contribute to comprehension. Seven-year-olds (n = 22) were observed reading one touch screen storybook and one print storybook with their mothers. Story comprehension was inferior for the touch screen storybooks compared to the print versions. Touch screen interactivity had no significant effect on comprehension but did affect shared reading behaviors. The mother-child dyads spent less time talking about the story in the highly interactive touch screen condition, despite longer shared reading sessions because of touch screen interactions. Positive emotional engagement was greater for children and mothers in the highly interactive touch screen condition, due to additional positive emotions expressed during touch screen interactions. Negative emotional engagement was greater for children when reading and talking about the story in the highly interactive condition, and some mothers demonstrated negative emotional engagement with the touch screen activities. The less interactive touch screen storybook had little effect on shared reading behaviors, but mothers controlling behaviors were more frequent. Storybook format had no effect on the frequency of mothers’ cognitive scaffolding behaviors (comprehension questions, word help). Relationships between comprehension and shared reading behaviors were examined for each storybook, and length of the shared reading session and controlling behaviors had significant effects on comprehension, but the mechanisms driving comprehension were not fully explained by the data. The potential for touch screen storybooks to contribute to cognitive overload in seven-year-old developing readers is discussed, as is the complex relationship between cognitive and emotional scaffolding behaviors, emotional engagement, and comprehension. Sample characteristics and methodological limitations are also discussed to help inform future research

Sensory and Emotional Perception of Wooden Surfaces through Fingertip Touch

Previous studies on tactile experiences have investigated a wide range of material surfaces across various skin sites of the human body in self-touch or other touch modes. Here, we investigate whether the sensory and emotional aspects of touch are related when evaluating wooden surfaces using fingertips in the absence of other sensory modalities. Twenty participants evaluated eight different pine and oak wood surfaces, using sensory and emotional touch descriptors, through the lateral motion of active fingertip exploration. The data showed that natural and smooth wood surfaces were perceived more positively in emotional touch than coated surfaces. We highlight the importance of preserving the naturalness of the surface texture in the process of wood-surface treatment so as to improve positive touch experiences, as well as avoid negative ones. We argue that the results may offer possibilities in the design of wood-based interior products with a view to improving consumer touch experiences.Peer reviewe

Expressive touch: Control of robot emotional expression by touch

In this paper, we present a work on control of robot emotional expression using touch sensing. A tactile Bayesian framework is proposed for recognition of different types of touch gestures. We include a sequential analysis method that, based on the accumulation of evidence from tactile interaction, allows to achieve accurate results for recognition of touch. Input data to our method is obtained from touch sensing, which is an important modality for social robotics. Here, emotion in the robot platform are represented by facial expressions, that are handled by a developed control architecture. We validate our method with experiments on tactile interaction in simulated and real robot environments. Results demonstrate that our proposed method is suitable and accurate for control of robot emotions through interaction with humans using touch sensing. Furthermore, it is demonstrated the potential that touch provides as a non-verbal communication channel for the development of social robots capable to interact with humans

Validation and psychometric properties of the Russian version of the Touch Experiences and Attitudes Questionnaire

It has been demonstrated that nurturing and affiliative touch is essential for human emotional and physical well-being throughout our entire life. Within the last 30 years a system of low-threshold mechanosensitive C fibers innervating the hairy skin was discovered and described; this system is hypothesized to represent the neurobiological substrate for the affective and rewarding properties of touch. This discovery opens new perspectives for multidisciplinary research of the role of affiliative social touch in health and disease, and calls for establishing novel psychometric tools assessing individual differences in the domain of affective touch. The main objective of the study was to construct and validate a Russian version of the Touch Experiences and Attitudes Questionnaire (TEAQ), a self-report measure recently developed to quantify individual experience and attitude to social and affective touch. A pool of 117 items was translated into Russian and all the items were assessed for appropriateness for Russian culture (232 participants). After exploring the factor structure (468 participants), we composed a 37-item questionnaire (TEAQ-37 Rus) characterized by good reliability and a clear 5-factor structure, covering the aspects of attitude to intimate touch, attitude to friendly touch, attitude to self-care, current intimate touch experiences, and childhood touch experiences. Confirmatory factor analysis (551 participants) has demonstrated good consistency and reliability of the 5-factor structure of the TEAQ-37 Rus. Cross-validation research demonstrated moderate positive correlations between predisposition to social touch and emotional intelligence; positive correlations with extraversion and openness facets of the Big Five personality model were also found. As predicted, participants with higher TEAQ scores rated all observed kinds of touch as more pleasant, with a particular preference for slow touch. We anticipate that this questionnaire will be a valuable tool for researchers of social touch, touch perception abnormalities, and the importance of touch experiences for emotional and mental health

Reading the mind in the touch: Neurophysiological specificity in the communication of emotions by touch

Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.Touch is central to interpersonal interactions. Touch conveys specific emotions about the touch provider, but it is not clear whether this is a purely socially learned function or whether it has neurophysiological specificity. In two experiments with healthy participants (N = 76 and 61) and one neuropsychological single case study, we investigated whether a type of touch characterised by peripheral and central neurophysiological specificity, namely the C tactile (CT) system, can communicate specific emotions and mental states. We examined the specificity of emotions elicited by touch delivered at CT-optimal (3 cm/s) and CT-suboptimal (18 cm/s) velocities (Experiment 1) at different body sites which contain (forearm) vs. do not contain (palm of the hand) CT fibres (Experiment 2). Blindfolded participants were touched without any contextual cues, and were asked to identify the touch provider's emotion and intention. Overall, CT-optimal touch (slow, gentle touch on the forearm) was significantly more likely than other types of touch to convey arousal, lust or desire. Affiliative emotions such as love and related intentions such as social support were instead reliably elicited by gentle touch, irrespective of CT-optimality, suggesting that other top-down factors contribute to these aspects of tactile social communication. To explore the neural basis of this communication, we also tested this paradigm in a stroke patient with right perisylvian damage, including the posterior insular cortex, which is considered as the primary cortical target of CT afferents, but excluding temporal cortex involvement that has been linked to more affiliative aspects of CT-optimal touch. His performance suggested an impairment in ‘reading’ emotions based on CT-optimal touch. Taken together, our results suggest that the CT system can add specificity to emotional and social communication, particularly with regards to feelings of desire and arousal. On the basis of these findings, we speculate that its primary functional role may be to enhance the ‘sensual salience’ of tactile interactions.Peer reviewedFinal Published versio

The effect of relationship status on communicating emotions through touch

Research into emotional communication to date has largely focused on facial and vocal expressions. In contrast, recent studies by Hertenstein, Keltner, App, Bulleit, and Jaskolka (2006) and Hertenstein, Holmes, McCullough, and Keltner (2009) exploring nonverbal communication of emotion discovered that people could identify anger, disgust, fear, gratitude, happiness, love, sadness and sympathy from the experience of being touched on either the arm or body by a stranger, without seeing the touch. The study showed that strangers were unable to communicate the self-focused emotions embarrassment, envy and pride, or the universal emotion surprise. Literature relating to touch indicates that the interpretation of a tactile experience is significantly influenced by the relationship between the touchers (Coan, Schaefer, & Davidson, 2006). The present study compared the ability of romantic couples and strangers to communicate emotions solely via touch. Results showed that both strangers and romantic couples were able to communicate universal and prosocial emotions, whereas only romantic couples were able to communicate the self-focused emotions envy and pride

A Touching Agent : Integrating Touch in Social Interactions between Human and Embodied Conversational Agent in an Immersive Environment

International audienceEmbodied conversational agents (ECAs) are endowed with more and more social and emotional capabilities. They can build rapport with humans by expressing thoughts and emotions through verbal and non-verbal behaviors. However, ECAs often lack the sense of touch, which is an important communicative and emotional capability, in particular in the context of an immersive environment. The sense of touch has been shown to be essential to the social development and general well-being of human beings, from their infancy to adulthood. It is thought to be a facilitator in the establishment of relationships and it is overall considered a very important medium of communication, especially for the communication of emotions. In many languages being touched designates not only physical contact but also being moved by something, feeling something on an emotional level. While in adulthood touch is usually kept for the closest relationships, it is nonetheless present in our daily lives (in greetings for example). We therefore believe that adding touch to the social capabilities of artificial agents would contribute to their ability to build rapport and emotional connections with humans. But to which extent would granting an ECA the ability to touch and be touched enhance its ability to communicate emotions and to build and maintain a social and emotional relationship with a human? To investigate this interrogation, our work focuses on the development of a touching agent: touching in the physical sense as well as the emotional sense. In the context of an immersive environment, our autonomous virtual ECA should be able to perceive and interpret touch, as well as decide how and when to perform it based on the overall interaction and emotional state of its human partner. Our first results are so far promising as to the credibility of such a touching agent

Touching virtual humans: Haptic responses reveal the emotional impact of affective agents

Interpersonal touch is critical for social-emotional development and presents a powerful modality for communicating emotions. Virtual agents of the future could capitalize on touch to establish social bonds with humans and facilitate cooperation in virtual reality (VR). We studied whether the emotional expression of a virtual agent would affect the way humans touch the agent. Participants were asked to hold a pressure-sensing tube presented as the agent's arm in VR. Upon seeing the agent's emotional expression change, participants briefly squeezed the arm. The effect of emotional expressions on affective state was measured using self-reported valence and arousal as well as physiology-based indices. Onset, duration, and intensity of the squeeze were recorded to examine the haptic responses. Emotional expression of agents affected squeeze intensity and duration through changes in emotional perception and experience. Haptic responses may thus provide an implicit measure of persons' experience towards their virtual companion.Peer reviewe

How do mothers nurture love via parenting?

Love and compassion are two of the most persuasive emotional attachments in the family. Mothers’ true love empowers children’s survival in the world and hereafter. Thus, this research aims to understand on how the Malaysian award winners for exemplary mothers category (Ibu Mithālī) show their love and mercy to their children in order to develop parent-child attachment. To answer the research question, research was done using Grounded Theory approach. As a result, three main themes have emerged: physical touch, emotional touch and spiritual touch. Love and mercy from mothers are pertinent in child development. Therefore, mothers should nurture their children with love and compassion to balance firm discipline and strict rules in the family